Dual layer eScreen to compensate for ambient lighting

ABSTRACT

A dual layer e-screen includes a top layer of a transparent lenticular or parallax material backed by an e-screen made of a material with controllable grey scales such as electronic paper. The top layer is controllable compensates for ambient lighting by creating a controllable surface that allows for uniform light distribution across the screen, while providing for adaptive contrast levels that selectively darken areas where light is not needed to more accurate display shadows from projected images. The eScreen can be additionally arranged to dynamically alter the gray scale matched to the video being shown to support viewing high dynamic range video through a projector. The gray scale used for each pixel element is biased to the ambient lighting conditions to remove the ambient light from the HDR video playback.

FIELD

The application relates generally to dual layer eScreens to compensatefor ambient lighting.

BACKGROUND

Television designers have gone to great lengths to control the backlightlevel even going so far as to provide per pixel backlight control forliquid crystal display (LCD) televisions. At the same time, the amountof light emitted by the television has increased dynamically. Couplingthis large increase in both contrast and brightness with moving to tenbits per color component (over the eight bits previously used) createswhat is termed “High Dynamic Range” (HDR) content.

Because of the monochromatic nature of projection screens, it has beendifficult to realize HDR content through a projector system. In allowedU.S. patent application Ser. No. 15/004,200, owned by the presentassignee, an electronic eScreen capable of pixel level gray scaleadjustment was disclosed that could be applied to a wall or othersupporting substrate to provide a large surface for a video projector.

SUMMARY

As understood herein, ambient light can reflect from a projector screensuch as an eScreen and deleteriously affect the viewing experience.

Accordingly, a system includes a projection screen assembly which inturn includes a screen substrate and a lenticular layer interposedbetween a video projector and the screen substrate. The lenticular layerincludes plural elements that are configurable to selectively allowlight from the projector to impinge on the screen substrate to renderimages thereon.

In example embodiments, circuitry controls at least some of theelements. In non-limiting examples the circuitry can be configured tocontrol at least a first element of the plural elements to allow lightfrom the projector to impinge on the screen substrate, and to control atleast a second element of the plural elements to reflect ambient lightnot from the projector away from the screen substrate. In someembodiments the circuitry can be configured to control at least firstand second elements of the plural elements to redirect light from theprojector onto the screen substrate, the projector being an ultra shortthrow projector. In some embodiments the circuitry can be configured tocontrol at least first and second elements of the plural elements toredirect light from the projector onto the screen substrate tocompensate for off-axis viewing of the screen substrate.

The lenticular elements may include piezoelectric elements, liquidcrystals, electrochromic elements, micro mirrors, and combinationsthereof.

In some embodiments, the screen substrate is an e-screen defining pluralpixels, and the plural elements of the lenticular layer correspond torespective pixels of the e-screen.

In another aspect, a projection screen assembly includes a screensubstrate, and a grid of configurable elements interposed between avideo projector and the screen substrate. The elements are configurableto selectively allow light from the projector to impinge on the screensubstrate to render images thereon.

In another aspect, a method includes configuring elements of a layerinterposed between a video projector and a screen substrate toselectively allow light from the projector to impinge on the screensubstrate to render images thereon. The method also includes activatingthe projector to project demanded images through the layer onto thescreen substrate.

The details of the present application, both as to its structure andoperation, can best be understood in reference to the accompanyingdrawings, in which like reference numerals refer to like parts, and inwhich:

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a block diagram of an example system including an example inaccordance with present principles;

FIG. 2 is a schematic view of the projection screen showing largerprojected pixels superimposed on groups of smaller screen pixels toillustrate that each projected pixel is associated with a respectivegroup of screen pixels;

FIG. 3 is a schematic view of the projection screen illustrating anexample alignment initialization process, in which one or more edges ofthe projected pixel footprint are aligned with respective edges of thescreen;

FIG. 4 is a schematic view of the projection screen illustrating anexample alignment process, in which a mapping of the association of thescreen pixels to projected pixels is generated;

FIG. 5 is a flow chart of example logic;

FIG. 6 is schematic side view of a lenticular screen over an e-inkscreen mounted to a vertical substrate such as a wall;

FIG. 7 is a side view of an assembly in which the lenticular layer isintegrated into the screen substrate;

FIG. 8 is a schematic diagram illustrating a lenticular layer allowinglight from a projector to pass to the screen substrate while rejectingambient light from sources that are not co-located with the projector;

FIG. 9 is a schematic diagram illustrating a lenticular layercompensating for an ultra short throw (UST) projector;

FIG. 10 is a schematic diagram illustrating a lenticular layercompensating for parallax owing to off-axis viewing positions; and

FIGS. 11-13 are flow charts of example logic according to presentprinciples.

DETAILED DESCRIPTION

This disclosure relates generally to computer ecosystems includingaspects of consumer electronics (CE) device networks such as projectorsystems. A system herein may include server and client components,connected over a network such that data may be exchanged between theclient and server components. The client components may include one ormore computing devices including video projectors and projector screens,portable televisions (e.g. smart TVs, Internet-enabled TVs), portablecomputers such as laptops and tablet computers, and other mobile devicesincluding smart phones and additional examples discussed below. Theseclient devices may operate with a variety of operating environments. Forexample, some of the client computers may employ, as examples, operatingsystems from Microsoft, or a Unix operating system, or operating systemsproduced by Apple Computer or Google. These operating environments maybe used to execute one or more browsing programs, such as a browser madeby Microsoft or Google or Mozilla or other browser program that canaccess web applications hosted by the Internet servers discussed below.

Servers and/or gateways may include one or more processors executinginstructions that configure the servers to receive and transmit dataover a network such as the Internet. Or, a client and server can beconnected over a local intranet or a virtual private network. A serveror controller may be instantiated by a game console such as a SonyPlaystation (trademarked), a personal computer, etc.

Information may be exchanged over a network between the clients andservers. To this end and for security, servers and/or clients caninclude firewalls, load balancers, temporary storages, and proxies, andother network infrastructure for reliability and security. One or moreservers may form an apparatus that implement methods of providing asecure community such as an online social website to network members.

As used herein, instructions refer to computer-implemented steps forprocessing information in the system. Instructions can be implemented insoftware, firmware or hardware and include any type of programmed stepundertaken by components of the system.

A processor may be any conventional general purpose single- ormulti-chip processor that can execute logic by means of various linessuch as address lines, data lines, and control lines and registers andshift registers.

Software modules described by way of the flow charts and user interfacesherein can include various sub-routines, procedures, etc. Withoutlimiting the disclosure, logic stated to be executed by a particularmodule can be redistributed to other software modules and/or combinedtogether in a single module and/or made available in a shareablelibrary.

Present principles described herein can be implemented as hardware,software, firmware, or combinations thereof; hence, illustrativecomponents, blocks, modules, circuits, and steps are set forth in termsof their functionality.

Further to what has been alluded to above, logical blocks, modules, andcircuits described below can be implemented or performed with one ormore general purpose processors, a digital signal processor (DSP), afield programmable gate array (FPGA) or other programmable logic devicesuch as an application specific integrated circuit (ASIC), discrete gateor transistor logic, discrete hardware components, or any combinationthereof designed to perform the functions described herein. A processorcan be implemented by a controller or state machine or a combination ofcomputing devices.

The functions and methods described below, when implemented in software,can be written in an appropriate language such as but not limited to C#or C++, and can be stored on or transmitted through a computer-readablestorage medium such as a random access memory (RAM), read-only memory(ROM), electrically erasable programmable read-only memory (EEPROM),compact disk read-only memory (CD-ROM) or other optical disk storagesuch as digital versatile disc (DVD), magnetic disk storage or othermagnetic storage devices including removable thumb drives, etc. Aconnection may establish a computer-readable medium. Such connectionscan include, as examples, hard-wired cables including fiber optics andcoaxial wires and digital subscriber line (DSL) and twisted pair wires.Such connections may include wireless communication connectionsincluding infrared and radio.

Components included in one embodiment can be used in other embodimentsin any appropriate combination. For example, any of the variouscomponents described herein and/or depicted in the Figures may becombined, interchanged or excluded from other embodiments.

“A system having at least one of A, B, and C” (likewise “a system havingat least one of A, B, or C” and “a system having at least one of A, B,C”) includes systems that have A alone, B alone, C alone, A and Btogether, A and C together, B and C together, and/or A, B, and Ctogether, etc.

Now specifically referring to FIG. 1, an example ecosystem 10 is shown,which may include one or more of the example devices mentioned above anddescribed further below in accordance with present principles. The firstof the example devices included in the system 10 is a projection screenassembly 12. The projection screen assembly 12 can be established bysome or all of the components shown in FIG. 1. The projection screenassembly 12 includes an active display or screen in that it containsaddressable screen elements that establish screen pixels and that can becontrolled to establish grayscale values as demanded by a video file tobe shortly disclosed.

For example, the projection screen assembly 12 can include one or moree-ink type screens or displays 14 that may be implemented by one or moree-ink arrays. An e-ink array may be made of small polyethylene spheres(for instance, between seventy five and one hundred micrometers indiameter). Each sphere may be made of negatively charged black plasticon one side and positively charged white plastic on the other. Thespheres can be embedded in a transparent silicone sheet, with eachsphere suspended in a bubble of oil so that it can rotate freely. Thepolarity of the voltage applied to each pair of electrodes thendetermines whether the white or black side is face-up, thus giving thepixel a white or black appearance. Other e-ink technology may usepolyvinylidene fluoride (PVDF) as the material for spheres. Other e-inktechnologies includes electrophoretic with titanium dioxide particlesapproximately one micrometer in diameter dispersed in a hydrocarbon oil,Microencapsulated Electrophoretic Displays, electrowetting,electrofluidic, and interferometric modulator displays that can createvarious colors using interference of reflected light, bistable displayssuch as flexible plastic electrophoretic displays, cholesteric liquidcrystal displays, nemoptic displays made of nematic materials organictransistors embedded into flexible substrates, electrochromic displays,etc.

Other active screen technology that may be used include “metamaterials”, chemical-based active screens, and screens with pixelsestablished by carbon nanotubes.

The projection screen assembly 12 may include one or more speakers 16for outputting audio in accordance with present principles, and at leastone input device 18 such as e.g. an audio receiver/microphone or key pador control keys for e.g. entering commands to at least one screenprocessor 20. The example screen assembly 12 may also include one ormore network interfaces 22 for communication over at least one network24 such as the Internet, an WAN, an LAN, etc. under control of the oneor more processors 20. Thus, the interface 22 may be, withoutlimitation, a Wi-Fi transceiver, which is an example of a wirelesscomputer network interface, such as but not limited to a mesh networktransceiver, or it may be a Bluetooth or wireless telephony transceiver.It is to be understood that the processor 20 controls the screenassembly 12 to undertake present principles, including the otherelements of the screen assembly 12 described herein such as e.g.controlling the display 14 to present images thereon and receiving inputtherefrom. Furthermore, note the network interface 22 may be, e.g., awired or wireless modem or router, or other appropriate interface suchas, e.g., a wireless telephony transceiver, or Wi-Fi transceiver asmentioned above, etc.

In addition to the foregoing, the screen assembly 12 may also includeone or more input ports 26 such as, e.g., a high definition multimediainterface (HDMI) port or a USB port to physically connect (e.g. using awired connection) to another CE device and/or a headphone port toconnect headphones to the screen assembly 12 for presentation of audiofrom the screen assembly 12 to a user through the headphones. Forexample, the input port 26 (and/or network interface 22) may beconnected via wire or wirelessly via the network 24 to a cable orsatellite or other audio video source 28 with associated sourceprocessor 28A and source computer memory 28B. Thus, the source may be,e.g., a separate or integrated set top box, or a satellite receiver. Or,the source 28 may be a game console or personal computer or laptopcomputer or disk player. Yet again, the source 28 and/or the color videosource discussed below may be cloud servers on the Internet, and mayinclude and perform “cloud” functions such that the devices of thesystem 10 may access a “cloud” environment via the server 28 in exampleembodiments. Or, the server 28 may be implemented by a game console orother computer in the same room as the other devices shown in FIG. 1 ornearby.

In any case, the video source 28 controls the reflectance of the videoshown on the screen assembly 12 by the below-described projector byinputting grayscale values to the active pixels of the screen assembly12. The video source 28 may be a separate video source as shown whichreceives full color video and derives a grayscale rendering thereofaccording to principles discussed below, in which case the source 28 istailored to source a separate piece of grayscale content to maximize theusage of the reflectance properties of the screen assembly 12. Such asource 28 may be separate from the screen assembly 12 as shown or it maybe incorporated into the screen assembly 12 in some implementations.

Or the source 28 may be the same as the color video source mentionedbelow, in which case the color video source may include a color videofile for projection onto the screen assembly 12 and a correspondinggrayscale video file that is sent to the screen assembly 12 to controlthe active elements in the screen assembly 12.

The screen assembly 12 may further include one or more computer memories30 such as disk-based or solid state storage that are not transitorysignals, in some cases embodied in the chassis of the screen asstandalone devices or as a personal video recording device (PVR) orvideo disk player either internal or external to the chassis of the AVDDfor playing back AV programs or as removable memory media.

Still referring to FIG. 1, in addition to the AVDD 12, the system 10 mayinclude one or more other device types. When the system 10 is a homenetwork, communication between components may be according to thedigital living network alliance (DLNA) protocol. Or, the projector andscreen can be used in a public movie theater.

In one example, a front projector 32 such as but not limited to a Sonyultra short throw (UST) projector may be used to project demanded imagesonto the front of the display 14. The example projector 32 may includeone or more network interfaces 34 for communication over the network 24under control of one or more projector processors 36. Thus, theinterface 34 may be, without limitation, a Wi-Fi transceiver, which isan example of a wireless computer network interface, including meshnetwork interfaces, or a Bluetooth transceiver, or a wireless telephonytransceiver.

It is to be understood that the projector processor 36 controls theprojector 32 to undertake present principles. In this regard, theprojector processor 36 may receive signals representing demanded colorimages from a color video source 38 which may be the same as ordifferent from the video source 28 described previously and which may beestablished by any one or more of the source types described previously.When separate grayscale and color sources are used, as opposed toseparate grayscale and color video files on the same source, the sources28, 38 may communicate with each other, e.g., via a wired communicationpath or via the network 24 as shown.

The projector processor 36 controls a lamp assembly 40 to project colorlight onto the screen assembly 12. The lamp assembly may be a laser lampassembly or other type of color illuminator assembly. The projector mayfurther include one or more computer memories 42 such as disk-based orsolid state storage.

As shown in FIG. 1, the screen 12 may be mounted on a substrate 44 suchas but not limited to a wall or window.

FIG. 2 illustrates that each of at least some and more typically all ofthe full color projection pixels 200 that are projected onto the screen14 by the projector 32 may be superimposed on a respective group ofmultiple smaller screen pixels 202. In the embodiment of FIG. 2, thescreen pixels 202 are the active addressable elements of the activescreen, e.g., e-ink globes. Thus, the projected pixels 200 thatestablish the color video images are larger than the active pixels 202within the screen 14. In the example shown, four screen pixels 202 arecorrelated to a single projected pixel 200, although different numbersof screen pixels 202 may be correlated to the projected pixels 200. Notethat depending on screen curvature and other factors as discussed below,while each projected pixel 200 typically overlaps multiple screen pixels202, the number of screen pixels 202 assigned to a first projected pixel200 may not be the same as the number of screen pixels 202 assigned to asecond projected pixel 200.

In the example shown, the projected pixels 202 are illustrated asrectilinear areas that border each other across the entirety of thescreen 14. In implementation the shape of each projected pixel 202 maynot be precisely rectilinear owing to bleed over of light caused byreflection and other effects including lens structure on the projector32, but present principles understand that such bleed over betweenadjacent projected pixels 200 is minimized owing to the grayscalecontrol afforded by control of the screen pixels 202 described below.Also, in implementation the footprint of the combined projected pixels200 that establish the color video image may not be exactly coterminouswith, and may be smaller than, the entire active area of the screen 14,in which case FIG. 2 illustrates only the region of the active portionof the screen 14 onto which the color image is projected.

FIG. 3 illustrates an example alignment initialization process of acalibration process for assigning groups of screen pixels to individualprojected pixels. In some implementations, the edges of the projectedimage from the projector 32 are first aligned with edges of the activearea of the screen 14. In the example shown, a left-most column 300 ofprojected pixels 200 can be projected onto the screen 14. A calibrationcamera 302 may capture the image of the column 300. The calibrationcamera 302 can be controlled by a processor 304.

Based on the image from the calibration camera 302, the optics of theprojector 32 and/or the direction in which the projector 32 is pointedand/or the distance at which the projector 32 is from the screen 14 canbe modified to align the left-most column 300 with the left edge 306 ofthe active portion of the screen 14 as shown, with the left edge beingmade more visibly manifest by causing the left-most one, two, or threecolumns of screen pixels 202 to be all white. The projector 32 may bemoved left or right by hand by a person observing the image of thecolumn 300 and/or the column 300 itself as it appears on the screen. Or,the processor 304 may receive the image of the column 300 and control amotor 308 (such as a servo or stepper motor or other appropriateapparatus) to move the optics and/or housing of the projector 32 toalign the column 300 with the left edge 306.

Note that in some implementations, the left most column 300 may not bealigned with the left edge 306 of the active portion of the screen butrather with a column of screen pixels 202 that is inboard of the leftedge and thereafter regarded as a virtual left edge by the system.

It may also be desirable to align the projector 32 with the top edge 310of the screen 14, with the top edge being made more visibly manifest ifdesired by causing the top-most one, two, or three rows of screen pixels202 to be all white. In the example shown, a top-most row 312 ofprojected pixels 200 can be projected onto the screen 14. Thecalibration camera 302 may capture the image of the row 312.

Based on the image from the calibration camera 302, the optics of theprojector 32 and/or the direction in which the projector 32 is pointedand/or the distance at which the projector 32 is from the screen 14 canbe modified to align the top-most row 312 with the top edge 310 of theactive portion of the screen 14 as shown. The projector 32 may be movedhand by a person observing the image of the row 312 and/or looking atthe row 312 itself as it appears on the screen. Or, the processor 304may receive the image of the row 312 and control the motor 308 to movethe optics and/or housing of the projector 32 to align the row 312 withthe top edge 310.

Note that in some implementations, the top most column 312 may not bealigned with the top edge 310 of the active portion of the screen butrather with a column of screen pixels 202 that is below the top edge andthereafter regarded as a virtual top edge by the system. Note furtherthat the edges 306, 310 may alternatively be the physical edges of thescreen if desired, when the physical edges are not coterminous with theedges of the active portion of the screen.

If desired, once the left and top rows of projected are aligned with theleft and top edges as described, the right and bottom projected pixelcolumn/row may be aligned with the respective edges of the screenaccording to the algorithm above by, e.g., expanding or shrinking thefootprint of the projected image using, e.g., the optics of theprojector or by other means. Or, once the first two edges are aligned,the remaining two edges of the projected image may be projected onto thescreen with the underlying screen pixels thus being designated as thevirtual right and bottom edge of the screen for calibration purposes.

Present principles recognize that rows and columns of screen pixels 202may not be precisely linear. For example, the screen 14 may bedeliberately configured to be mildly concave, and/or local artifactsmight exist to introduce non-linearity. Accordingly, FIG. 4 illustratesthat once the projector 32 is aligned with the physical or virtual edgesof the screen 14, groups of screen pixels 202 may be associated withrespective projected pixels 200 so that when color video is projectedonto the screen by means of the projected pixels 200, the grayscale ofthe respective screen area onto which each projected pixel is directedis established by the screen pixels associated with that projected pixelaccording to disclosure below, even in the presence of non-linearities.

For illustration purposes, FIG. 4 assumes that each projected pixel 200encompasses an on-screen area in which three columns and two rows ofscreen pixels 202 are present. Thus, each of at least some, and in mostcases all, of the projected pixels 200 is associated with plural (e.g.,six) screen pixels 202. As shown, a column of projected pixels 200 maybe projected onto the screen 14. It is to be understood that the processof FIG. 4 can start with the left-most column, working right. Rows mayalso be aligned according to the algorithm described herein, top tobottom. Or, a grid of projected pixels may be projected onto the screen,combining column alignment and row alignment in a consolidated process.

For simplicity of disclosure, a single column 400 of projected pixels200 ₁-200 ₇ is shown and screen assignment discussed for the pixels inthat column. FIG. 4 shows five columns 202A, 202B, 202C, 202D, 202E ofscreen pixels with the three left-most columns 202A-C initially beingassigned to the column 400 of projected pixels. Candidate columns ofscreen pixels may be “illuminated” for calibration purposes by, e.g.,causing the pixels in the candidate columns all to assume the whiteconfiguration.

FIG. 4 illustrates that the columns 202A-E are not linear, with theleft-most column 202A moving out of the projected column 400 and thefourth column 200D moving into the projected column 400 beginning at thethird projected pixel 200 ₃. The screen pixel columns shift back rightby one pixel beginning at the sixth projected pixel 200 ₆. The alignmentset up in FIG. 4 may be imaged by the calibration cameras shown in FIG.3, for example, with the calibration image being sent to one or more ofthe above-described processors for image analysis to note theabove-described non-linearity of the screen pixel columns.

In the example shown, the first, second, sixth, and seventh projectedpixels 200 ₁, 200 ₂, 200 ₆, 200 ₇ would be associated with screen pixelsin the respective row of the respective projected pixel from the firstthrough third columns 202A, 202B, 202C of screen pixels based on, e.g.,imaging the presence of those screen pixels within the respectiveprojected pixels, with screen pixels in other candidate columns notbeing associated with these respective projected pixels. In contrast,the third, fourth, and fifth projected pixels 200 ₃, 200 ₄, 200 ₅ wouldbe associated with screen pixels in the respective row of the respectiveprojected pixel from the second through fourth columns 202B, 202C, 202Dof screen pixels. The process may continue using successive columns andthen rows (or using a grid as mentioned above) of projected pixels toassociate respective groups of screen pixels 202 with each respectiveone of at least some and preferably all projected pixels 200 whileaccounting for possible non-linearities in the screen 14.

Now referring to FIG. 5, the overall logic of example implementationsmay be seen. At block 500 screen pixel groups are associated with eachindividual projected pixel according to the algorithms described above.Thus, each one of some or all of the color pixels in a color video fileto be projected is associated with a respective plurality of screenpixels.

The grayscale value to be established by the screen pixels associatedwith a particular color pixel to be projected are then derived asfollow. At block 502, for a color video file to be projected onto thescreen 14, the logic moves to block 504 to derive a grayscale file fromthe color video file. The grayscale file may be derived on apixel-by-pixel basis.

Any appropriate method may be used for deriving a grayscale file from acolor file such that the grayscale values in the grayscale file aresynchronized with the color values in the color file using, e.g., timinginformation carried over from the color file into the grayscale file.

As examples, a grayscale value can be derived as follows for each colorpixel to be projected.

In systems in which luminance is directly indicated in the pixel data,that luminance may be used as the grayscale value.

When the pixel data indicates only color values for red, green, and blue(RGB), the corresponding grayscale value to be inserted into thegrayscale file can use weighted sums calculated from the RGB values, ifdesired after the gamma compression function has been removed first viagamma expansion.

In some embodiments, gamma expansion may be defined as:

-   -   C_\mathrm{linear}= \begin{cases}\frac{C_\mathrm{srgb}}{12.92}, &        C_\mathrm{srgb}\le0.04045\\        \left(\frac{C_\mathrm{srgb}+0.055}{1.055}\right)∧{2.4}, &        C_\mathrm{srgb}>0.04045 \end{cases}

where Csrgb represents any of the three gamma-compressed sRGB primaries(Rsrgb, Gsrgb, and Bsrgb, each in range [0,1]) and Clinear is thecorresponding linear-intensity value (R, G, and B, also in range [0,1]).

Then, luminance can be calculated as a weighted sum of the threelinear-intensity values. The sRGB color space is defined in terms of theCIE 1931 linear luminance Y, which is given byY=0.2126R+0.7152G+0.0722B.  [5]

The coefficients represent the measured intensity perception of typicaltrichromat humans, depending on the primaries being used; in particular,human vision is most sensitive to green and least sensitive to blue. Toencode grayscale intensity in linear RGB, each of the three primariescan be set to equal the calculated linear luminance Y (replacing R,G,Bby Y,Y,Y to get this linear grayscale). Linear luminance typically needsto be gamma compressed to get back to a conventional non-linearrepresentation.

In contrast, for images in color spaces such as Y′UV and its relatives,which are used in standard color TV and video systems such as PAL,SECAM, and NTSC, a nonlinear luma component (Y′) can be calculateddirectly from gamma-compressed primary intensities as a weighted sum,which can be calculated quickly without the gamma expansion andcompression used in colorimetric grayscale calculations. In the Y′UV andY′IQ models used by PAL and NTSC, the grayscale component can becomputed asY′=0.299R′+0.587G′+0.114B′

where the prime distinguishes these gamma-compressed values from thelinear R, G, B, and Y discussed above.

Yet again, for the ITU-R BT.709 standard used for HDTV developed by theATSC, the grayscale value “Y′” can be calculated as:Y′=0.2126R′+0.7152G′+0.0722B′.

Although these are numerically the same coefficients used in sRGB above,the effect is different because they are being applied directly togamma-compressed values.

Recall that each color pixel to be projected is associated with pluralscreen pixels. Accordingly, once a single grayscale value is establishedfor each color pixel to be projected, the process then uses thatgrayscale value to establish screen pixel control data defining theconfiguration of each of the plural screen pixels associated with therespective color pixel to be projected. Thus, each grayscale value maybe expanded into “N” screen pixel control values to establish, for eachscreen pixel in the group of “N” screen pixels associated with the colorpixel to be projected from whence the grayscale value was derived,whether that screen pixel is to be controlled to be white or black.

In one embodiment, this is done using stippling or stippling-liketechniques, in which for lighter grayscale values, more of the screenpixels are caused to present a white appearance, and for darkergrayscale values, more of the screen pixels are caused to present ablack appearance, sometimes using randomly-selected pixels from amongthe group of screen pixels.

As additional illustrative examples of stippling-like techniques,halftoning or dithering may be used to configure the plural screenpixels associated with the respective color pixel to be projected toestablish the derived grayscale value. Example non-limiting details ofsuch techniques may be found in, e.g., Martin et al., “Scale-Dependentand Example-Based Stippling”, Computers & Graphics, 35(1):160-174 (2011)and Salomon, “The Computer Graphics Manual” (Springer-Verlag London,Ltd., 2011), both of which are incorporated herein by reference.

Note that the grayscale file may contain either one or both of thegrayscale values corresponding to a single color pixel to be projected,and the

In cases in which the refresh rate of the color video is faster than therefresh rate afforded by the active screen, each grayscale value may bean average of multiple color video values for the associated color pixelto be projected during a single cycle of screen refresh to which thegrayscale value applies. For example, if the screen is refreshed 30times per second and the color video is refreshed 60 times per second,each grayscale value may be the average of the two grayscale valuesderived from the two color pixels to be projected during the singlescreen refresh period. Or, each grayscale value may be a selected one ofthe multiple color video values for the associated color pixel to beprojected during a single cycle of screen refresh to which the grayscalevalue applies.

While a 4K screen is mentioned above, it is to be understood that otherscreen resolutions are encompassed by present principles. For example,individual pixels can be increased on the screen for 8K or higherprojection systems or combined to a visually equivalent e-ink contrastgrid that allows for larger grayscale areas or blocks. This couldhappen, for instance, when a 4K projection is presented on a very largescreen. The combination of the screen size and the projection resolutioninfluences the size of the matching grayscale contrast areas or blocksof e-ink on the screen. Moreover, the e-ink areas can be adjusted forpixel aspect ratios of different sizes, such as square versusrectangular. The e-ink pixel area shape and size can be tailored to howthe color video to be projected is shot, e.g., either as DV or intendedfor film.

FIG. 6 illustrates an assembly 600 that includes a dual layer e-screencombination, with a first layer 602 including any of the e-screensdisclosed above, and typically mounted to a vertical substrate 604 suchas a wall or window. In FIG. 6, a lenticular layer 606 is disposedagainst the opposite side of the e-screen 602 from the wall 604 suchthat the e-screen 602 is sandwiched between the lenticular layer 606 andthe wall 604. As stated above, the e-screen 602 compensates for ambientlighting by creating a controllable surface that allows for uniformlight distribution across the screen. As recognized by the embodiment ofFIG. 6, the lenticular layer 606 provides the additional feature ofproviding for adaptive contrast levels that selectively darken areaswhere light is not needed to more accurate display shadows fromprojected images. Control of the e-screen 602 and/or lenticular layer606 may be effected by one or more processors 608 via appropriatecontrol circuitry/drivers in a manner analogous to how controllablebacklit LED/LCD TVs operate. The elements of the lenticular screen 606can be locally “dimmed”, thus allowing for an adaptive contrast ratiothat is higher than the native contrast ratio. By having smallpixel-sized sections of a projection screen capable of being grayed todifferent levels, a higher bit depth of colors is allowed and this inturn expands the color gamut capable of being delivered from aprojector. Screens that allow for adaptive local dimming are suitablefor 4K UHD HDR projector applications. Present principles can apply toshort throw projection systems as well.

Example elements that can establish the lenticular layer 606 include anarray of micro mirrors, an array of liquid crystals, an array ofpiezoelectric elements, an array of electrochromic elements, andcombinations thereof. In some embodiments each element of the lenticularlayer 606 may correspond to a respective pixel of the e-screen 602. Theelements of the lenticular layer 606 may be individually configuredindependently of other elements to reflect light in ways describedbelow, or groups of elements may be collectively controlled/configuredindependently of other groups.

Thus, as shown in FIG. 6, the lenticular layer 606 is applied as aseparate layer to the e-screen 602.

In another embodiment (FIG. 7), the e-screen layer is manufactured intothe lenticular screen material to provide a homogenous, monolithicscreen 700 that may be mounted on a wall 702 or other typically verticalsubstrate, including windows.

In an embodiment as shown in FIG. 8, the elements (shown in grid form)of the lenticular layer 606 may be configured to pass light 802 from aprojector 800 to the e-screen 602, while rejecting ambient light 806originating elsewhere, such as from a lamp 84 or other point source. Insuch an embodiment, the point source 804 may be sensed by light sensorsand the elements of the lenticular layer 606 configured (as by movingthem or otherwise actuating them) to reflect light from the point sourceaway from the e-screen, with the projector 800 position being known andthe elements of the lenticular layer 606 being configured to pass lightfrom the projector 800 to the e-screen.

In the embodiment shown in FIG. 9, the elements of the lenticular layer606 are configured to redirect light 902 from a projector such as a USTprojector 900 to the e-screen 602 in a way that provides a lenticularpattern 904 that is always be perpendicular to the e-screen 602 asshown. Similarly, if desired the elements of the lenticular layer 606can be configured to redirect light 902 from a projector such as a USTprojector 900 to the e-screen 602 in a way that provides a lenticularpattern 904 that is always be perpendicular to the projector 900. In anexample, both the layers 602, 606 and projector 900 are located atpredetermined distances and orientations relative to each other, so thatthe desired angle of light redirection between the projector 900 ande-screen 602 is easily determined, with the elements of the lenticularlayer 606 being configured to achieve the desired angles of lightredirection.

FIG. 10 illustrates that the e-screen 602 onto which the projected imageis to be seen can have a centerline 1000 or other screen reference, andan expected viewer location 1002 can be defined relative to the screenreference. The expected viewer location 1002 may be off-axis, i.e., maybe offset from a directly perpendicular view of the e-screen, in whichcase parallax distortions may result. Because the expected viewerlocation 1002 and its offset from the e-screen reference is known inadvance, the parallax effects of the off-axis relationship between thetwo is known, and ray corrections determined accordingly. FIG. 10illustrates the parallax effect by illustrating diverging light raysfrom the projector 1004, which are slightly redirected by configuringthe elements of the lenticular layer 606 to eliminate the parallaxdistortions at the expected viewing location 1002, as illustrated by theconverging lines 1006 emanating from the lenticular layer 606 toward thee-screen 602.

Note that the above principles may be combined. For example, theprinciples of FIGS. 9 and 10 may be realized in a single system.

FIGS. 11-13 illustrate logic executable by any of the processorsdisclosed herein that can respectively accompany the systems shown inFIGS. 8-10. At block 1100 in FIG. 11, for example, the location of theprojector 800 relative to the e-screen 602 is received by, e.g., userinput during system set up, or by image recognition executed on an imagefrom a camera, or by other appropriate means. The elements of thelenticular layer 606 are configured at block 1102 to pass light from theprojector 800 to the e-screen 602 wile reflecting ambient light thatdoes not propagate from the direction of the projector 800 away from thee-screen at block 1104.

FIG. 12 indicates that at block 1200 the location of the projector 900relative to the e-screen 602 is received by, e.g., user input duringsystem set up, or by image recognition executed on an image from acamera, or by other appropriate means. The elements of the lenticularlayer 606 are configured at block 1202 to provide a lenticular pattern904 that is perpendicular to either the e-screen 602 or the projector900 as desired.

FIG. 13 illustrates that the expected viewer location 1002, screenreference 1000, and if desired projector 1004 location from FIG. 10 maybe received at block 1300. Using the geometric relationship betweenthese parameters, parallax is determined at block 1302. The elements ofthe lenticular layer 606 are then configured at block 1304 to compensatefor the parallax effect by removing calculated distortions in the rays1006 from the projector 1004.

The eScreen can be additionally arranged to dynamically alter the grayscale matched to the video being shown to support viewing high dynamicrange video through a projector. The gray scale used for each pixelelement is biased to the ambient lighting conditions to remove theambient light from the HDR video playback.

Another embodiment this invention could also address non-homogeneousambient light by assigning the changes in grey scale to different zonesof the e-screen. These zones would compensate by locally changing thegray level in each zone to thereby provide a localized compensation.This would ostensibly improve display uniformity.

The above methods may be implemented as software instructions executedby a processor, including suitably configured application specificintegrated circuits (ASIC) or field programmable gate array (FPGA)modules, or any other convenient manner as would be appreciated by thoseskilled in those art. Where employed, the software instructions may beembodied in a device such as a CD Rom or Flash drive or any of the abovenon-limiting examples of computer memories that are not transitorysignals. The software code instructions may alternatively be embodied ina transitory arrangement such as a radio or optical signal, or via adownload over the internet.

It will be appreciated that whilst present principals have beendescribed with reference to some example embodiments, these are notintended to be limiting, and that various alternative arrangements maybe used to implement the subject matter claimed herein.

What is claimed is:
 1. A system comprising: a projection screen assemblycomprising: a screen substrate to reflect light from a video projector;a lenticular layer interposed between the video projector and the screensubstrate, the lenticular layer comprising plural elements configurableto selectively allow light from the projector to impinge on the screensubstrate to render images thereon; and circuitry controlling at leastsome of the elements.
 2. The system of claim 1, wherein the circuitry isconfigured to: control at least a first element of the plural elementsto allow light from the projector to impinge on the screen substrate;and control at least a second element of the plural elements to reflectambient light not from the projector away from the screen substrate. 3.The system of claim 1, wherein the circuitry is configured to: controlat least first and second elements of the plural elements to redirectlight from the projector onto the screen substrate, the projector beingan ultra short throw projector.
 4. The system of claim 1, wherein thecircuitry is configured to: control at least first and second elementsof the plural elements to redirect light from the projector onto thescreen substrate to compensate for off-axis viewing of the screensubstrate.
 5. The system of claim 1, wherein the screen substratecomprises an e-screen.
 6. The system of claim 1, wherein the elementscomprise piezoelectric elements.
 7. The system of claim 1, wherein theelements comprise liquid crystals.
 8. The system of claim 1, wherein theelements comprise electrochromic elements.
 9. The system of claim 5,wherein the e-screen defines plural pixels, and the plural elementscorrespond to respective pixels of the e-screen.
 10. A projection screenassembly comprising: a screen substrate; a grid of configurable elementsinterposed between a video projector and the screen substrate, theelements being configurable to selectively allow light from theprojector to impinge on the screen substrate to render images on thescreen substrate; and circuitry controlling at least some of theconfigurable elements.
 11. The assembly of claim 10, wherein thecircuitry is configured to: control at least a first element of theplural elements to allow light from the projector to impinge on thescreen substrate; and control at least a second element of the pluralelements to reflect ambient light not from the projector away from thescreen substrate.
 12. The assembly of claim 10, wherein the circuitry isconfigured to: control at least first and second elements of the pluralelements to redirect light from the projector onto the screen substrate,the projector being an ultra short throw projector.
 13. The assembly ofclaim 10, wherein the circuitry is configured to: control at least firstand second elements of the plural elements to redirect light from theprojector onto the screen substrate to compensate for off-axis viewingof the screen substrate.
 14. The assembly of claim 10, wherein thescreen substrate comprises an e-screen.
 15. The assembly of claim 10,comprising the projector.
 16. A method comprising: controlling, usingcircuitry, elements of a layer interposed between a video projector anda screen substrate to selectively allow light from the projector toimpinge on the screen substrate to render images on the screensubstrate; and activating the projector to project demanded imagesthrough the layer onto the screen substrate.
 17. The method of claim 16,comprising: controlling at least a first element of the plural elementsto allow light from the projector to impinge on the screen substrate;and controlling at least a second element of the plural elements toreflect ambient light not from the projector away from the screensubstrate.
 18. The method of claim 16, comprising: controlling at leastfirst and second elements of the plural elements to redirect light fromthe projector onto the screen substrate to compensate for off-axisviewing of the screen substrate.